Repository navigation
[VideoGenX] sweep H3 latency on 2, 4 and 8 H100 GPUs / [VideoGenX] 在 2、4、8 张 H100 上扫描 H3 延迟 - #4857
Merged
Merged
Conversation
edwingao28
requested review from
Ankur-singh,
RohitNagraj,
chunfangamd,
kedarpotdar-nv,
nvpohanh and
wzhao18
as code owners
November 6, 2026 06:29
Contributor
|
Thanks for the contribution!
中文感谢你的贡献!
|
5 of 11 tasks
Contributor
|
View unofficial run (performance): https://inferencex.semianalysis.com/inference?unofficialRun=42177029852 View unofficial run (accuracy): https://inferencex.semianalysis.com/evaluation?unofficialRun=42177029852 |
…t-sweep # Conflicts: # inferencex-e2e/perf-changelog.yaml
Collaborator
Author
|
/use 42177029852 |
Contributor
|
@edwingao28 staged run 42177029852. This run has no staged performance curves. This run remains available across future |
…t-sweep # Conflicts: # inferencex-e2e/perf-changelog.yaml
5 of 11 tasks
…t-sweep # Conflicts: # inferencex-e2e/docs/MODELS.md # inferencex-e2e/docs/video-generation.md # inferencex-e2e/perf-changelog.yaml
5 of 11 tasks
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
H100 has one MiniMax-H3 C1 video point, on 4 GPUs, so it cannot show how video latency scales with GPU count.
Changes:
h3-bf16-h100-sglang-videoadds C1 points on 2 and 8 GPUs beside the existing 4-GPU point. H100 starts at 2 GPUs because the model does not fit one 80 GB GPU.serving-client-tp2.yaml) and Ulysses 4 on 8 GPUs (serving-client-tp2-ulysses4.yaml). The 4-GPU point keeps its existing recipe.MODELS.md,video-generation.md) list the new points.Results: MiniMax-H3 C1,
h3-v2.yamlrelease-v1 (20 clips, 1344x768, 124 frames, 49 steps), SGLang v0.5.23, qualifying sweep 42177029852 attempt 1 at62dd0294a.validate-video-resultsaccepted all 3 native deployments, the result bundles carry the planned recipe fingerprints, and every server loaded the pinned MiniMax-H3 snapshot.latency_median_secondsalso counts client-side media validation, which adds 0.59 to 0.62 s to each median.Related: #4818 (MI355X), #4852 (B200) and #4856 (H200) add the other SKUs. Whichever merges later reconciles the shared doc sentence and the changelog tail.
PR checklist and change type
Type of Change
Checklist
python -m infx.matrix.changed --base origin/mainlists affected config keys, I have appended one new entry covering them to the physical end ofinferencex-e2e/perf-changelog.yaml; if it lists none, I have added none. I have not edited historical entriesinferencex-e2e/perf-changelog.yamlentry, it carries exactly one primary sweep label (a maintainer applies it on fork PRs):full-sweep-fail-fast(recommended),full-sweep-enabled, ornon-canary-full-sweep-enabled. Optional modifiersall-evals,evals-only, andagentx-fastrequire a primary label; the last two block reuse while applied.OWNER/MEMBER/COLLABORATOR) has commented/use <run_id>(or the legacy/reuse-sweep-run) on this PR. Do this only once there is a final full sweep that is all green with evals passing, since after this comment the primary sweep label will no longer automatically kick off new sweeps. Remove and re-add the primary sweep label to force a new sweep.